Assessing the quality and value of metabolic chart data for capturing core outcomes for pediatric medium-chain acyl-CoA dehydrogenase (MCAD) deficiency.

BACKGROUND: Generating rigorous evidence to inform care for rare diseases requires reliable, sustainable, and longitudinal measurement of priority outcomes. Having developed a core outcome set for pediatric medium-chain acyl-CoA dehydrogenase (MCAD) deficiency, we aimed to assess the feasibility of prospective measurement of these core outcomes during routine metabolic clinic visits. METHODS: We used existing cohort data abstracted from charts of 124 children diagnosed with MCAD deficiency who participated in a Canadian study which collected data from birth to a maximum of 11 years of age to investigate the frequency of clinic visits and quality of metabolic chart data for selected outcomes. We recorded all opportunities to collect outcomes from the medical chart as a function of visit rate to the metabolic clinic, by treatment centre and by child age. We applied a data quality framework to evaluate data based on completeness, conformance, and plausibility for four core MCAD outcomes: emergency department use, fasting time, metabolic decompensation, and death. RESULTS: The frequency of metabolic clinic visits decreased with increasing age, from a rate of 2.8 visits per child per year (95% confidence interval, 2.3-3.3) among infants 2 to 6 months, to 1.0 visit per child per year (95% confidence interval, 0.9-1.2) among those ≥ 5 years of age. Rates of emergency department visits followed anticipated trends by child age. Supplemental findings suggested that some emergency visits occur outside of the metabolic care treatment centre but are not captured. Recommended fasting times were updated relatively infrequently in patients' metabolic charts. Episodes of metabolic decompensation were identifiable but required an operational definition based on acute manifestations most commonly recorded in the metabolic chart. Deaths occurred rarely in these patients and quality of mortality data was not evaluated. CONCLUSIONS: Opportunities to record core outcomes at the metabolic clinic occur at least annually for children with MCAD deficiency. Methods to comprehensively capture emergency care received at outside institutions are needed. To reduce substantial heterogeneous recording of core outcome across treatment centres, improved documentation standards are required for recording of recommended fasting times and a consensus definition for metabolic decompensations needs to be developed and implemented.

Patient Engagement in a Multi-Stakeholder Workshop to Plan the Collection of Patient-Oriented Outcomes for Children with Inherited Metabolic Diseases.

Building on a study to develop core outcome sets for children with rare inherited metabolic diseases, the purpose of this workshop was to inform the design of longitudinal pediatric registries that support registry-based clinical trials. This workshop was co-designed by two patient/family partner investigators and attended by two family advisors who received preparatory training. Patient partners and advisors recommended integrating the collection of registry data into everyday life and highlighted the importance of transparent communication and attention to the issue of integration of patient-reported data into clinical care. We propose a need to explore strategies for engaging patients in post-project knowledge translation.

Families' healthcare experiences for children with inherited metabolic diseases: protocol for a mixed methods cohort study.

INTRODUCTION: Children with inherited metabolic diseases (IMDs) often have complex and intensive healthcare needs and their families face challenges in receiving high-quality, family centred health services. Improvement in care requires complex interventions involving multiple components and stakeholders, customised to specific care contexts. This study aims to comprehensively understand the healthcare experiences of children with IMDs and their families across Canada. METHODS AND ANALYSIS: A two-stage explanatory sequential mixed methods design will be used. Stage 1: quantitative data on healthcare networks and encounter experiences will be collected from 100 parent/guardians through a care map, 2 baseline questionnaires and 17 weekly diaries over 5-7 months. Care networks will be analysed using social network analysis. Relationships between demographic or clinical variables and ratings of healthcare experiences across a range of family centred care dimensions will be analysed using generalised linear regression. Other quantitative data related to family experiences and healthcare experiences will be summarised descriptively. Ongoing analysis of quantitative data and purposive, maximum variation sampling will inform sample selection for stage 2: a subset of stage 1 participants will participate in one-on-one videoconference interviews to elaborate on the quantitative data regarding care networks and healthcare experiences. Interview data will be analysed thematically. Qualitative and quantitative data will be merged during analysis to arrive at an enhanced understanding of care experiences. Quantitative and qualitative data will be combined and presented narratively using a weaving approach (jointly on a theme-by-theme basis) and visually in a side-by-side joint display. ETHICS AND DISSEMINATION: The study protocol and procedures were approved by the Children's Hospital of Eastern Ontario's Research Ethics Board, the University of Ottawa Research Ethics Board and the research ethics boards of each participating study centre. Findings will be published in peer-reviewed journals and presented at scientific conferences.

Establishing a core outcome set for mucopolysaccharidoses (MPS) in children: study protocol for a rapid literature review, candidate outcomes survey, and Delphi surveys.

BACKGROUND: Mucopolysaccharidoses (MPS) are a group of inherited metabolic diseases characterized by chronic, progressive multi-system manifestations with varying degrees of severity. Disease-modifying therapies exist to treat some types of MPS; however, they are not curative, underscoring the need to identify and evaluate co-interventions that optimize functioning, participation in preferred activities, and quality of life. A Canadian pediatric MPS registry is under development and may serve as a platform to launch randomized controlled trials to evaluate such interventions. To promote the standardized collection of patient/family-reported and clinical outcomes considered important to patients/families, health care providers (HCPs), and policymakers, the choice of outcomes to include in the registry will be informed by a core outcome set (COS). We aim to establish a patient-oriented COS for pediatric MPS using a multi-stakeholder approach. METHODS: In step 1 of the six-step process to develop the COS, we will identify relevant outcomes through a rapid literature review and candidate outcomes survey. A two-phase screening approach will be implemented to identify eligible publications, followed by extraction of outcomes and other pre-specified data elements. Simultaneously, we will conduct a candidate outcomes survey with children with MPS and their families to identify outcomes most important to them. In step 2, HCPs experienced in treating patients with MPS will be invited to review the list of outcomes generated in step 1 and identify additional clinically relevant outcomes. We will then ask patients/families, HCPs, and policymakers to rate the outcomes in a set of Delphi Surveys (step 3), and to participate in a subsequent consensus meeting to finalize the COS (step 4). Step 5 involves establishing a set of outcome measurement instruments for the COS. Finally, we will disseminate the COS to knowledge users (step 6). DISCUSSION: The proposed COS will inform the choice of outcomes to include in the MPS registry and, more broadly, promote the standardized collection of patient-oriented outcomes for pediatric MPS research. By involving patients/families from the earliest stage of the research, we will ensure that the COS will be relevant to those who will ultimately benefit from the research. TRIAL REGISTRATION: PROSPERO CRD42021267531 , COMET.

Patient and family engagement in the development of core outcome sets for two rare chronic diseases in children.

BACKGROUND: Core outcome sets (COS) are lists of consensus-determined outcomes to be measured and reported in all clinical research studies within a disease area. While including patients and families in COS development to improve their relevance and applicability to patient values is key, there is limited literature documenting practical barriers and facilitators to successful patient engagement in COS development. In this paper, as researchers and patient partners, we provide a resource for COS developers to meaningfully and effectively engage patients and families. MAIN BODY: To establish a consensus-based COS for children with two inherited metabolic diseases (medium-chain acyl-CoA dehydrogenase deficiency and phenylketonuria), we conducted an evidence review, Delphi survey, and workshop. Two adult patient partner co-investigators co-developed the study protocol, co-designed strategies to address challenges with incorporating patient perspectives, and led all patient engagement activities, including communication with a group of family advisors. Seven adult family advisors received training about COS development and subsequently contributed to Delphi survey development, outcome definitions, the consensus workshop, and selection of outcome measurement instruments. Patient partner co-investigators and family advisors were essential to the successful design, conduct, and completion of the two COS. Patient partner co-investigators supported the understanding, inclusion and engagement of family advisors, and helped develop accessible tools to determine patient-oriented outcome measurement instruments. Patient partner co-investigators and family advisors collaborated with the study team to co-develop surveys, modify technical language, and recruit participants to the study. Together, we addressed challenges to patient engagement in COS development such as unfamiliarity with study methods, comprehensibility of materials and ongoing engagement, and power imbalances between team members. CONCLUSION: Our approach to patient and family engagement in COS development for two rare conditions for children was feasible and considered valuable by all study team members, including patients and family members, in improving the relevance of the deliverable to patients. This approach to patient engagement in developing COS can be applied to other paediatric disease contexts, allowing patient and family perspectives to influence the direction of future studies to develop COS.

Core outcome sets (COS) are lists of outcomes agreed upon by a group of people to be measured and reported in studies about certain diseases and populations. Core outcomes are meant to represent what is useful to study from the perspectives of health care providers, researchers and patients. For researchers who seek to include patients in the development of a COS, there is little guidance about how to do this well. We recently developed COS for two rare diseases in children, medium-chain acyl-CoA dehydrogenase deficiency and phenylketonuria. We did this by reviewing available information from published research, surveying health care providers, researchers, and patients, and eventually coming to agreement during a workshop. We included two adult patient partner co-researchers who helped design the COS study and co-developed the patient engagement strategy. These partners formed relationships with seven adult family advisors, who helped ensure that materials were accessible, participated in outcome selection, and helped select tools to measure core outcomes. Strategies we used to engage patient partners included a) training about both the scientific research process and how to help other researchers in the future, and b) frequent communication about study progress and how family advisor feedback was used. Also, we made sure that the impacts of power imbalances between health care providers, researchers and patients were low. Our approach to patient engagement in COS development for two rare conditions in children proved to be both feasible and considered valuable by all study team members, including patient partners and family advisors. To include patient perspectives and values, future COS developers may take a similar approach.

Core Outcome Sets for Medium-Chain Acyl-CoA Dehydrogenase Deficiency and Phenylketonuria.

BACKGROUND: Evidence to guide treatment of pediatric medium-chain acyl-coenzyme A dehydrogenase (MCAD) deficiency and phenylketonuria (PKU) is fragmented because of large variability in outcome selection and measurement. Our goal was to develop core outcome sets (COSs) for these diseases to facilitate meaningful future evidence generation and enhance the capacity to compare and synthesize findings across studies. METHODS: Parents and/or caregivers, health professionals, and health policy advisors completed a Delphi survey and participated in a consensus workshop to select core outcomes from candidate lists of outcomes for MCAD deficiency and PKU. Delphi participants rated the importance of outcomes on a nine-point scale (1-3: not important, 4-6: important but not critical, 7-9: critical). Candidate outcomes were progressively narrowed down over 3 survey rounds. At the workshop, participants evaluated the remaining candidate outcomes using an adapted nominal technique, open discussion, and voting. After the workshop, we finalized the COSs and recommended measurement instruments for each outcome. RESULTS: There were 85, 61, and 53 participants across 3 Delphi rounds, respectively. The candidate core outcome lists were narrowed down to 20 outcomes per disease to be discussed at the consensus workshop. Voting by 18 workshop participants led to COSs composed of 8 and 9 outcomes for MCAD deficiency and PKU, respectively, with measurement recommendations. CONCLUSIONS: These are the first known pediatric COSs for MCAD deficiency and PKU. Adoption in future studies will help to ensure best use of limited research resources to ultimately improve care for children with these rare diseases.

Stakeholder perspectives on clinical research related to therapies for rare diseases: therapeutic misconception and the value of research.

BACKGROUND: For many rare diseases, few treatments are supported by strong evidence. Patients, family members, health care providers, and policy-makers thus have to consider whether to accept, recommend, or fund treatments with uncertain clinical effectiveness. They must also consider whether and how to contribute to clinical research that may involve receiving or providing the therapy being evaluated. OBJECTIVE: To understand why and how patients and families with rare metabolic diseases, specialist metabolic physicians, and health policy advisors choose whether to participate in studies and how they use and value research. METHODS: We conducted separate focus group interviews with each stakeholder group (three groups in total); two groups were conducted by telephone and the third was held in-person. Participants were recruited using purposive sampling. We analyzed each interview transcript sequentially using a qualitative description approach to inductively identify key themes. Several strategies to ensure credibility and trustworthiness were used including debriefing sessions after each focus group and having multiple team members review transcripts. RESULTS: Four patients/caregivers, six physicians, and three policy advisors participated. Our findings did not support conventional perspectives that therapeutic misconception (gaining access to treatment) is the main motivating factor for patients/caregivers to participate in clinical research. Rather, patients'/caregivers' expressed reasons for participating in research included advancing science for the next generation and having an opportunity to share their experiences. Patients/caregivers and physicians described the difficulties in weighing risks versus benefits of accepting treatments not well-supported by evidence. Physicians also reported feeling conflicted in their dual role as patient advisor/advocate and evaluator of the evidence. Policy advisors were primarily focused on critically appraising the evidence to make recommendations for the health system. CONCLUSIONS: Stakeholders differ in their perspectives on rare disease research but share concerns about the risks versus benefits of therapies when making individual- and population-level decisions.

Developments in evidence creation for treatments of inborn errors of metabolism.

Inborn errors of metabolism (IEM) represent the first group of genetic disorders, amenable to causal therapies. In addition to traditional medical diet and cofactor treatments, new treatment strategies such as enzyme replacement and small molecule therapies, solid organ transplantation, and cell-and gene-based therapies have become available. Inherent to the rare nature of the single conditions, generating high-quality evidence for these treatments in clinical trials and under real-world conditions has been challenging. Guidelines developed with standardized methodologies have contributed to improve the practice of care and long-term clinical outcomes. Adaptive trial designs allow for changes in sample size, group allocation and trial duration as the trial proceeds. n-of-1 studies may be used in small sample sized when participants are clinically heterogeneous. Multicenter observational and registry-based clinical trials are promoted via international research networks. Core outcome and standard data element sets will enhance comparative analysis of clinical trials and observational studies. Patient-centered outcome-research as well as patient-led research initiatives will further accelerate the development of therapies for IEM.

Evaluation of the quality of clinical data collection for a pan-Canadian cohort of children affected by inherited metabolic diseases: lessons learned from the Canadian Inherited Metabolic Diseases Research Network.

BACKGROUND: The Canadian Inherited Metabolic Diseases Research Network (CIMDRN) is a pan-Canadian practice-based research network of 14 Hereditary Metabolic Disease Treatment Centres and over 50 investigators. CIMDRN aims to develop evidence to improve health outcomes for children with inherited metabolic diseases (IMD). We describe the development of our clinical data collection platform, discuss our data quality management plan, and present the findings to date from our data quality assessment, highlighting key lessons that can serve as a resource for future clinical research initiatives relating to rare diseases. METHODS: At participating centres, children born from 2006 to 2015 who were diagnosed with one of 31 targeted IMD were eligible to participate in CIMDRN's clinical research stream. For all participants, we collected a minimum data set that includes information about demographics and diagnosis. For children with five prioritized IMD, we collected longitudinal data including interventions, clinical outcomes, and indicators of disease management. The data quality management plan included: design of user-friendly and intuitive clinical data collection forms; validation measures at point of data entry, designed to minimize data entry errors; regular communications with each CIMDRN site; and routine review of aggregate data. RESULTS: As of June 2019, CIMDRN has enrolled 798 participants of whom 764 (96%) have complete minimum data set information. Results from our data quality assessment revealed that potential data quality issues were related to interpretation of definitions of some variables, participants who transferred care across institutions, and the organization of information within the patient charts (e.g., neuropsychological test results). Little information was missing regarding disease ascertainment and diagnosis (e.g., ascertainment method - 0% missing). DISCUSSION: Using several data quality management strategies, we have established a comprehensive clinical database that provides information about care and outcomes for Canadian children affected by IMD. We describe quality issues and lessons for consideration in future clinical research initiatives for rare diseases, including accurately accommodating different clinic workflows and balancing comprehensiveness of data collection with available resources. Integrating data collection within clinical care, leveraging electronic medical records, and implementing core outcome sets will be essential for achieving sustainability.

Outcomes in pediatric studies of medium-chain acyl-coA dehydrogenase (MCAD) deficiency and phenylketonuria (PKU): a review.

BACKGROUND: Inherited metabolic diseases (IMDs) are a group of individually rare single-gene diseases. For many IMDs, there is a paucity of high-quality evidence that evaluates the effectiveness of clinical interventions. Clinical effectiveness trials of IMD interventions could be supported through the development of core outcome sets (COSs), a recommended minimum set of standardized, high-quality outcomes and associated outcome measurement instruments to be incorporated by all trials in an area of study. We began the process of establishing pediatric COSs for two IMDs, medium-chain acyl-CoA dehydrogenase (MCAD) deficiency and phenylketonuria (PKU), by reviewing published literature to describe outcomes reported by authors, identify heterogeneity in outcomes across studies, and assemble a candidate list of outcomes. METHODS: We used a comprehensive search strategy to identify primary studies and guidelines relevant to children with MCAD deficiency and PKU, extracting study characteristics and outcome information from eligible studies including outcome measurement instruments for select outcomes. Informed by an established framework and a previously published pediatric COS, outcomes were grouped into five, mutually-exclusive, a priori core areas: growth and development, life impact, pathophysiological manifestations, resource use, and death. RESULTS: For MCAD deficiency, we identified 83 outcomes from 52 articles. The most frequently represented core area was pathophysiological manifestations, with 33 outcomes reported in 29/52 articles (56%). Death was the most frequently reported outcome. One-third of outcomes were reported by a single study. The most diversely measured outcome was cognition and intelligence/IQ for which eight unique measurement instruments were reported among 14 articles. For PKU, we identified 97 outcomes from 343 articles. The most frequently represented core area was pathophysiological manifestations with 31 outcomes reported in 281/343 articles (82%). Phenylalanine concentration was the most frequently reported outcome. Sixteen percent of outcomes were reported by a single study. Similar to MCAD deficiency, the most diversely measured PKU outcome was cognition and intelligence/IQ with 39 different instruments reported among 82 articles. CONCLUSIONS: Heterogeneity of reported outcomes and outcome measurement instruments across published studies for both MCAD deficiency and PKU highlights the need for COSs for these diseases, to promote the use of meaningful outcomes and facilitate comparisons across studies.

Health Care for Mitochondrial Disorders in Canada: A Survey of Physicians.

BACKGROUND: An improved understanding of diagnostic and treatment practices for patients with rare primary mitochondrial disorders can support benchmarking against guidelines and establish priorities for evaluative research. We aimed to describe physician care for patients with mitochondrial diseases in Canada, including variation in care. METHODS: We conducted a cross-sectional survey of Canadian physicians involved in the diagnosis and/or ongoing care of patients with mitochondrial diseases. We used snowball sampling to identify potentially eligible participants, who were contacted by mail up to five times and invited to complete a questionnaire by mail or internet. The questionnaire addressed: personal experience in providing care for mitochondrial disorders; diagnostic and treatment practices; challenges in accessing tests or treatments; and views regarding research priorities. RESULTS: We received 58 survey responses (52% response rate). Most respondents (83%) reported spending 20% or less of their clinical practice time caring for patients with mitochondrial disorders. We identified important variation in diagnostic care, although assessments frequently reported as diagnostically helpful (e.g., brain magnetic resonance imaging, MRI/MR spectroscopy) were also recommended in published guidelines. Approximately half (49%) of participants would recommend "mitochondrial cocktails" for all or most patients, but we identified variation in responses regarding specific vitamins and cofactors. A majority of physicians recommended studies on the development of effective therapies as the top research priority. CONCLUSIONS: While Canadian physicians' views about diagnostic care and disease management are aligned with published recommendations, important variations in care reflect persistent areas of uncertainty and a need for empirical evidence to support and update standard protocols.

Les soins de santé prodigués au Canada à des individus atteints de troubles mitochondriaux : une enquête menée auprès de médecins. Contexte: Dans le cas de patients atteints de troubles mitochondriaux rares, il est permis de croire qu'une meilleure compréhension des pratiques en matière de diagnostic et de traitement peut contribuer, au moyen des lignes directrices, à l'étalonnage et à l'établissement de priorités en ce qui regarde la recherche évaluative. Notre intention a été de décrire les soins prodigués au Canada par des médecins, notamment leur variabilité, dans le cas de ces patients. Méthodes: Pour ce faire, nous avons effectué une enquête transversale auprès de médecins canadiens qui posent des diagnostics de troubles mitochondriaux et qui prodiguent des soins continus aux patients qui en sont atteints. À cet effet, nous avons fait appel à la méthode d'enquête dite « en boule de neige ¼ (snowball sampling) afin d'identifier des participants possiblement admissibles. Ces derniers ont été ensuite contactés par la poste, et ce, à cinq reprises au maximum. Ils ont été invités à remplir un questionnaire et à le retourner par la poste ou en ligne. Ce questionnaire abordait les aspects suivants : leur expérience personnelle à titre de prestataire de soins ; leurs pratiques en matière de diagnostic et de traitement ; les défis se présentant à eux au moment d'avoir accès à des tests ou à des traitements ; et finalement leurs points de vue en ce qui regarde les priorités de la recherche. Résultats: Dans le cadre de cette enquête, nous avons reçu 58 réponses, ce qui représente un taux de 52 %. Une majorité de répondants (83 %) ont indiqué allouer 20 % ou moins de leur temps de pratique clinique aux soins de patients atteints de ces troubles. Nous avons également noté d'importantes variations concernant les soins et les diagnostics, et ce, même si les outils d'évaluation fréquemment considérés utiles sur le plan diagnostic (p. ex. : des IRM du cerveau/la spectroscopie par RM) étaient également recommandés dans des lignes directrices déjà publiées. Environ la moitié de nos répondants (49 %) recommanderaient volontiers un « cocktail ¼ de vitamines pour tous leurs patients ou la plupart d'entre eux. Quand il est question de vitamines spécifiques et de cofacteurs, nous avons cependant identifié une variation dans leurs réponses. Interrogés quant à la priorité numéro un en matière de recherche, une majorité de répondants a dit recommander la poursuite d'études portant sur la mise sur pied de traitements thérapeutiques efficaces. Conclusions: Bien que les points de vue de ces médecins canadiens en ce qui regarde les diagnostics et la prise en charge des troubles mitochondriaux soient en phase avec des recommandations publiées, d'importantes variations reflètent la persistance d'aspects incertains ainsi qu'un besoin de données empiriques afin de renforcer et de mettre à jour les protocoles de rééférence.

Using a meta-narrative literature review and focus groups with key stakeholders to identify perceived challenges and solutions for generating robust evidence on the effectiveness of treatments for rare diseases.

INTRODUCTION: For many rare diseases, strong analytic study designs for evaluating the efficacy and effectiveness of interventions are challenging to implement because of small, geographically dispersed patient populations and underlying clinical heterogeneity. The objective of this study was to integrate perspectives from published literature and key rare disease stakeholders to better understand the perceived challenges and proposed methodological approaches to research on clinical interventions for rare diseases. METHODS: We used a meta-narrative literature review and focus group interviews with key rare disease stakeholders to better understand the perceived challenges in generating and synthesizing treatment effectiveness evidence, and to describe various research methods for mitigating these identified challenges. Data from both components of this study were synthesized narratively according to research paradigms that emerged from our data. RESULTS: Results from our meta-narrative literature review and focus group interviews revealed three fundamental challenges in generating robust treatment effectiveness evidence for rare diseases: i) limitations in recruiting a sufficient sample size to achieve planned statistical power; ii) inability to account for clinical heterogeneity and assess treatment effects across a clinical spectrum; and iii) reliance on short-term, surrogate outcomes whose clinical relevance is often unclear. We mapped these challenges and associated solutions to three interrelated research paradigms: i) explanatory evidence generation; ii) comparative effectiveness/pragmatic evidence generation; and iii) patient-oriented evidence generation. Within each research paradigm, numerous criticisms and potential solutions have been described with respect to overcoming these challenges from a research study design perspective. CONCLUSIONS: Over time, discussions about clinical research for interventions for rare diseases have moved beyond methodological approaches to overcome challenges related to explanatory evidence generation, with increased recognition of the importance of pragmatic and patient-oriented evidence. Future directions for our work include developing a framework to expand current evidence synthesis practices to take into consideration many of the concepts discussed in this paper.

Establishing core outcome sets for phenylketonuria (PKU) and medium-chain Acyl-CoA dehydrogenase (MCAD) deficiency in children: study protocol for systematic reviews and Delphi surveys.

BACKGROUND: Inherited metabolic diseases (IMD) are a large group of rare single-gene disorders that are typically diagnosed early in life. There are important evidence gaps related to the comparative effectiveness of therapies for IMD, which are in part due to challenges in conducting randomized controlled trials (RCTs) for rare diseases. Registry-based RCTs present a unique opportunity to address these challenges provided the registries implement standardized collection of outcomes that are important to patients and their caregivers and to clinical providers and healthcare systems. Currently there is no core outcome set (COS) for studies evaluating interventions for paediatric IMD. This protocol outlines a study that will establish COS for each of two relatively common IMD in children, phenylketonuria (PKU) and medium-chain acyl-CoA dehydrogenase (MCAD) deficiency. METHODS: This two-part study is registered with the Core Outcome Measures in Effectiveness Trials (COMET) initiative. Part 1 includes a rapid review and development of an evidence map to identify a comprehensive listing of outcomes reported in past studies of PKU and MCAD deficiency. The review follows established methods for knowledge synthesis, including a comprehensive search strategy, two stages of screening citations against inclusion/exclusion criteria by two reviewers working independently, and extraction of important data elements from eligible studies, including details of the outcomes collected and outcome measurement instruments. The review findings will inform part 2 of our study, a set of Delphi surveys to establish consensus on the highest priority outcomes for each condition. Healthcare providers, families of children with PKU or MCAD deficiency, and health system decision-makers will be invited to participate in two to three rounds of Delphi surveys. The design of the surveys will involve parents of children with IMD who are part of a family advisory forum. DISCUSSION: This protocol is a crucial step in developing the capacity to launch RCTs with meaningful outcomes that address comparative effectiveness questions in the field of paediatric IMD. Such trials will contribute high-quality evidence to inform decision-making by patients and their family members, clinicians, and policy-makers.

Experiences of caregivers of children with inherited metabolic diseases: a qualitative study.

BACKGROUND: We sought to understand the experiences of parents/caregivers of children with inherited metabolic diseases (IMD) in order to inform strategies for supporting patients and their families. We investigated their experiences regarding the management of disease, its impact on child and family life, and interactions with the health care system. METHODS: From four Canadian centres, we conducted semi-structured telephone interviews with parents/caregivers of children with an IMD who were born between 2006 and 2015 and who were participating in a larger cohort study. Participants were selected with the aim of achieving a diverse sample with respect to treatment centre, IMD, and age of the child. Interviews emphasized the impacts of the disease and its treatment on the child and family and explicitly queried perceptions of interactions with the health care system. We identified emergent themes from the interview data. RESULTS: We completed interviews with 21 parents/caregivers. The 21 children were aged <1 to 7 years old with IMD that included amino acid disorders, urea cycle disorders, fatty acid oxidation disorders, and organic acid disorders or 'other' IMD. Most parents reported that they and their families had adapted well to their child's diagnosis. Parents used proactive coping strategies to integrate complex disease management protocols into routine family life. An important source of stress was concern about the social challenges faced by their children. Participants reported positive interactions with their most involved health care providers within the metabolic clinic. However, they reported challenges associated with the health care system outside of disease-specific metabolic care, when encountering systems and providers unfamiliar with the child's disease. CONCLUSIONS: The successful use of proactive coping strategies among parents of children with IMD in this study suggests the potential value of promoting positive coping and is an important direction for future study. Parents' social concerns for their children were important stressors that warrant consideration by health care providers positioned to support families. Our results with respect to experiences with care highlight the important role of specialized metabolic clinics and point to a need for better coordination of the care that takes place outside the disease-specific management of IMD.

Child and family experiences with inborn errors of metabolism: a qualitative interview study with representatives of patient groups.

BACKGROUND: Patient-centered health care for children with inborn errors of metabolism (IEM) and their families is important and requires an understanding of patient experiences, needs, and priorities. IEM-specific patient groups have emerged as important voices within these rare disease communities and are uniquely positioned to contribute to this understanding. We conducted qualitative interviews with IEM patient group representatives to increase understanding of patient and family experiences, needs, and priorities and inform patient-centered research and care. METHODS: We developed a sampling frame of patient groups representing IEM disease communities from Canada, the United States, and United Kingdom. With consent, we interviewed participants to explore their views on experiences, needs, and outcomes that are most important to children with IEM and their families. We analyzed the data using a qualitative descriptive approach to identify key themes and sub-themes. RESULTS: We interviewed 18 organizational representatives between February 28 and September 17, 2014, representing 16 IEMs and/or disease categories. Twelve participants voluntarily self-identified as parents and/or were themselves patients. Three key themes emerged from the coded data: managing the uncertainty associated with raising and caring for a child with a rare disease; challenges associated with the affected child's life transitions, and; the collective struggle for improved outcomes and interventions that rare disease communities navigate. CONCLUSION: Health care providers can support children with IEM and their families by acknowledging and reducing uncertainty, supporting families through children's life transitions, and contributing to rare disease communities' progress toward improved interventions, experiences, and outcomes.

Translating rare-disease therapies into improved care for patients and families: what are the right outcomes, designs, and engagement approaches in health-systems research?

There is a need for research to understand and improve health systems for rare diseases in order to ensure that new, efficacious therapies developed through basic and early translational science lead to real benefits for patients. Such research must (i) focus on appropriate patient-oriented outcomes, (ii) include robust study designs that can accommodate real-world decision priorities, and (iii) involve effective stakeholder-engagement strategies. For transformative therapies, study outcomes will need to shift toward longer-term goals in recognition of success in preventing catastrophic outcomes. For incremental therapies, outcomes should be selected in recognition of the impact of care on quality of life for patients and families. To generate new evidence, we suggest that hybrid study designs integrating elements of practice-based observational research and pragmatic trials hold the most promise for addressing priorities such as minimizing bias, accounting for cointerventions, identifying long-term impacts, and considering clinical heterogeneity. To effectively engage with stakeholders, a knowledge exchange infrastructure is needed to foster collaboration among patients with rare diseases and their families, health-care providers, researchers, and policy decision makers. A key priority for these groups must be collaboration toward a shared understanding of the outcomes that are of most relevance to the facilitation of patient-centered care.

Reimbursement-Based Economics--What Is It and How Can We Use It to Inform Drug Policy Reform?

BACKGROUND: In Ontario, approximately $3.8 billion is spent annually on publicly funded drug programs. The annual growth in Ontario Public Drug Program (OPDP) expenditure has been limited to 1.2% over the course of 3 years. Concurrently, the Ontario Drug Policy Research Network (ODPRN) was appointed to conduct drug class review research relating to formulary modernization within the OPDP. Drug class reviews by ODPRN incorporate a novel methodological technique called reimbursement-based economics, which focuses on reimbursement strategies and may be particularly relevant for policy-makers. OBJECTIVES: To describe the reimbursement-based economics approach. METHODS: Reimbursement-based economics aims to identify the optimal reimbursement strategy for drug classes by incorporating a review of economic literature, comprehensive budget impact analyses, and consideration of cost-effectiveness. This 3-step approach is novel in its focus on the economic impact of alternate reimbursement strategies rather than individual therapies. RESULTS: The methods involved within the reimbursement-based approach are detailed. To facilitate the description, summary methods and findings from a recent application to formulary modernization with respect to the drug class tryptamine-based selective serotonin receptor agonists (triptans) used to treat migraine headaches are presented. CONCLUSIONS: The application of reimbursement-based economics in drug policy reforms allows policy-makers to consider the cost-effectiveness and budget impact of different reimbursement strategies allowing consideration of the trade-off between potential cost savings vs increased access to cost-effective treatments.

Scoping review of patient- and family-oriented outcomes and measures for chronic pediatric disease.

BACKGROUND: Improvements in health care for children with chronic diseases must be informed by research that emphasizes outcomes of importance to patients and families. To support a program of research in the field of rare inborn errors of metabolism (IEM), we conducted a broad scoping review of primary studies that: (i) focused on chronic pediatric diseases similar to IEM in etiology or manifestations and in complexity of management; (ii) reported patient- and/or family-oriented outcomes; and (iii) measured these outcomes using self-administered tools. METHODS: We developed a comprehensive review protocol and implemented an electronic search strategy to identify relevant citations in Medline, EMBASE, DARE and Cochrane. Two reviewers applied pre-specified criteria to titles/abstracts using a liberal accelerated approach. Articles eligible for full-text review were screened by two independent reviewers with discrepancies resolved by consensus. One researcher abstracted data on study characteristics, patient- and family-oriented outcomes, and self-administered measures. Data were validated by a second researcher. RESULTS: 4,118 citations were screened with 304 articles included. Across all included reports, the most-represented diseases were diabetes (35%), cerebral palsy (23%) and epilepsy (18%). We identified 43 unique patient- and family-oriented outcomes from among five emergent domains, with mental health outcomes appearing most frequently. The studies reported the use of 405 independent self-administered measures of these outcomes. CONCLUSIONS: Patient- and family-oriented research investigating chronic pediatric diseases emphasizes mental health and appears to be relatively well-developed in the diabetes literature. Future research can build on this foundation while identifying additional outcomes that are priorities for patients and families.

Metabolic Clinic Atlas: Organization of Care for Children with Inherited Metabolic Disease in Canada.

INTRODUCTION: Nearly all children in Canada with an inherited metabolic disease (IMD) are treated at one of the country's Hereditary Metabolic Disease Treatment Centres. We sought to understand the system of care for paediatric IMD patients in Canada in order to identify sources of variation and inform future research priorities. METHODS: Treatment centres were contacted by email and invited to complete a web-based survey. The questionnaire addressed, for each centre, the population size served and scope of practice, available human resources and clinic services and research capacity. Survey responses were analyzed descriptively. RESULTS: We received responses from 13 of the 14 treatment centres invited to participate. These centres represent at least 85% of the Canadian population, with over half of the centres located in southern Ontario and Quebec. All centres reported paediatric patients with IMDs as their main patient population. A variety of dedicated staff was identified; every centre reported having at least one physician and one dietician. The most common ancillary services available included telehealth (11/12 respondents) and biochemical genetic laboratory testing (10/12), with a high variability of access to on-site laboratory tests. A majority of centres indicated access to additional off-site services, but barriers to these were reported. All but one centre indicated previous experience with research. CONCLUSIONS: The variation we identified in the organization of care highlights the need to investigate the association between practice differences and health outcomes for paediatric IMD patients to inform policies that establish equitable access to services that are beneficial.